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(54) Action analyzing/reconfing system 

(57) The action of a user who is canrying a movable 
terminal (1) is analyzed in a host terminal (3). TTie port- 
able terminal (1 ) detects the time and position where the 
portable (1) terminal is present at a predetermined time 
Interval and supplies the pieces of information to the 
host terminal (3). The host terminal (3) analyzes the 
time'seriaily detected information to recognize the mov- 
ing locus and the moving speed of the user who .is car- 
rying the movable terminal (3). The host terminal (3) 



has position information of railway lines and roads as 
line patterns. By matching processing between the 
moving locus and the line patterns, the transport facility 
used by the user for movement is estinr«ted. This inven- 
tion is to provide a system capable of analyzing/record- 
ing a daily action without performing any cumbersome 
operation, a 
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Description 

The present invention relates to a system for ana- 
lyzing the action of. e.g., a user who is carrying a porta- 
ble terminal on the tiasis of infbmiation acquired, from 
the portaUe terminal. 

Information representing the date^me and position 
of a visit and in some cases, information of a transport 
facility used need often be recorded as a daily action 
tecord. 

In such a case, the user makes a note on the self 
action in a pocKetbook or the like, or inputs the daily 
action to a personal computer or the like after he/she 
goes k>ack to the office. In recent years, a portat)le ter- 
minal is becoming popular, and instead of writing the 
action in the pockett>ook» tiie action record may be : 
sometimes input to the portable terminal. - 

The operation of writing the daily action, record in 
the pocketbook or inputting it to the personal computer 
is cumbersome. In ackfition, the writing or< data input 
operation is often forgotten, so no accurate action 
record can be made. • 

It is an object of the present invention to provide a : 
system for automatically analyzing outdoor action and 
recording it as an action record without performing any • 
cunnbersome recording operation. iv . 

To achieve the above object there is' provided an. 
action analyzing/recording system whereiri information 
transmitted through a comrrumication control unit of a 
terminal is analyzed by an information processing unit 
connected to a network as ah action record, data of an 
analysis result is stored in correspondence with a termi- 
nal kientification code, and the data is transferred to 
said terminal as needed, said terminal comprising a 
detector for detecting position information and time 
information, and said communication control unit for 
network connection, and transmitting the information . 
detected by said detector together with the terminal 
identification code. 

According to the present invention, the action of ^the 
user who is holding the terminail outdoors can be ana- . 
lyzed. and the means of transportation can be esti- . 
mated. Therefore, an accurate action can be 
automatically input witiiout requiring the user of any 
specif k; input operation. In addition, since the analyzed, 
data is recorded, the data can be referred to later as a 
persorial action record or record in a goods delivery 
operation and applied to various application purposes. 

Th^ invention can be more fully understood from 
the following detailed description when taken in con- 
junction with the acconrpanying drawings, in which: 

FIG. 1 is a view showing the system configuration of 
an embodiment; 

FIG. 2 is a perspective view showing the outer 
appearance of a portatrfe terminal; 
FIG. 3 is a block diagram of the portable terminal; 
FIG. 4 is a view shewing the structure of a packet 



sent from the portable terminal ; 
FIG. 5 is a flow chart of an operation of preparing a 
packet from data acquired t3y the portable terminal 
and sending the packet; 
5 FIG. 6 is a block diagram showing tiie arrangement 

of a host ternunal; 

FIG. 7 is a flow chart for explaining processing in 
the host terminal; 

RG. 8 is a view showing an example of tile moving 
10 route of a user who is canning the portable terrrB- 
nal; 

RG. 9 is a view showing an exanple of map data 
stored in the host terminal; 
FIG. 10 is a flow chart (1) of processing of estimat- 
es ing the action of the user who is carrying the porta- 
; ble terminal; 

RG. 1 1 is a flow chart (2) of processing of estimat- 
ing the action of the user who is carrying the porta- 
. . . k)le terminal; 
20,. FIG. 12 isaflow chart (3) of processing of estimat- 
ing the action of the user who is carrying the porta- 
ble terminal; 

FIG 13 is a view showing an example of the result 
obtained by estimating the action of the user who is 
25: carrying the portable terminal; 

' FIG. 14 is a view showing an example of an action 
record table of the user who is carrying the portable 
terminal: 

FIG. 15 is a flow chart of processing of preparing 
30 the action recool tat)le of the user wtio is carrying 
tiie portable terminal; 

FIG. 16 is a table which stores names on a map and 
corresponding position information; 
FIG. 17 is a flow chart of an operation of preparing 
35 . a packet from data acquired by the portable termi- 
nal and sendirig the packet; and 
FIG. 1 8 is a view illustrating the action record of the 
user who is carrying the portat>le terminal. 

40 ' . The embodiment of the present invention will be 
descried t>elow with reference to the accompanying 
. drawing. 

: FIG. 1 is a view showing the system configuration of 
this emlxxiiment. In this emlxxiimem. a systern for ana- 

45 lyzing the action of a user having a portai^e ternninal. 1 
in a host terminal (server machine) 3 accommodated in 
a public network 2 will be described. Assume that the • 
user is always carrying the portable terminal 1 r . 
The portak^le terminal 1 detects the position (e.g., 

so aa'^bb' north and cc^dd' east) of the portable terminal i 
at a certain time point arxi tNs time autonomously or in 
accordance with an Instruction from the portable termi- 
nal 1 and supplies the position and time information to 
the host terminal 3. At this time, the portat^le terminal 1 

55 is connected to the public network 2 through the nearest 
t>ase station 4. Upon t>eing notified of the position and 
time, the host terminal 3 recognizes the position of the 
user who is carrying the portable terminal 1 at the cer- 
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tain time. 

The portable terminal 1 supplies the information 
(position information and time information) to the host 
terminal 3 at every predetermined timing. The host ter- 
minal 3 analyzes the time-serially detected information, 5 
thereby recognizing the moving locus and the moving 
speed of the user of the portable temiinal 1 . 

FIG. 2 is a perspective view showing the outer 
appearance of the portable terminal 1 . The portable ter- 
minal 1 has an LCD display unit 11, a microphone 12, io 
and a general-purpose IF connector 13. A GPS (Global 
Positioning System) sensor 14 is connected to the gen- 
eral-purpose IF connector 13. The portable terminai V 
has a radio communication antenna 15. 

FIG- 3 is a l^lock diagram of the portable terminal 1 . is 
A CPU 21 executes a program stored in a storage unit 
22 (ROM and RAM). The CPU 21 and the storage unit 
22 are connected via a.lxjs 23. 

The storage unit 22 is constituted by a semiconduc- 
tor memory, a magnetic i^ecording mecfium. or an optical 20 
recording medium and stores the program, data, and * , ^ 
the IIKe. The storage unit 22 may be permanently incor- 
porated or detachably mounted in the portable terminal 
1. 

A recording medium driver 24 is connected to the 25 
bus 23 to read out data stored in a portable recording 
medium (including a senvcbnductor memory, a mag- 
netic disk, an optical disk, and a magnetooptical cfisk) 
25 or write data in the portable recording medium 25.' 
An IC card is assumed as an example of the portable ^ 30 - 
recording medium 25. The CPU 21 can also execute a 
program stored in the portable recording medium 25. 

The program and data to be recorded in the storage 
unit 22 may t)e received from another device connected ' 
through a communication line or the like, and recorded. 3S 
Alternatively, the CPU 21 may use, through tiie commu- 
nication line or the like, a program and data stored in a 
storage unit arranged on the another devicie side. 

A unit con^esponding to the LCD display unit 11 
comprises a liquid crystal display (LCD) 31. a memory. 40 
32 for storing irrformation to be displayed on the liquid ^ - ^ 
crystal display 31, an LCD driver 33 for outputting infor- 
mation stored in the memoiry 32 to the fiquid crystal dis- 
play 31 under the control of ah LCD control unit 34. and 
the LCD-control unit 34 for controlling the memory 32 45 
and the LCD driver 33. 

An A/D ' converter 35 converts sourid irif^ 
acquired through the microphone 12 into digital data. A 
sound irrformation control unit 36 outputs the sound 
information A/D-converted by the A/D converter 35 to so 
the bus 23. The sound information control unit 36 has a 
function of compressing sourKi information. 

The GPS sensor 14 detects the current position by * 
communicating with. eg., an artificial satellite. A gen- 
eral-purpose IF unit 37 outputs detected data from the ss 
GPS sensor 14 to the bus 23 in accordance with an 
instruction from the CPU 21. A timepiece 38 counts 
time. A timer 39 interrupts the CPU 21 at a predeter- 



pruned time interval. 

In sending data, a communication corrtrot unit 40 
prepares a transntissfon packet and transfers the packet 
to a radio transceiver 41 in accordance with an instruc- 
tion from the CPU 21 . In receiving data, the communica- 
tion control unit 40 outputs data stored in a packet 
received through the radio transceiver 41 onto the bus 
23. The radfo transceiver 41 is connected to the radio 
communication antenna 15 shown in FIG. 2 to trans- 
mit/receive data to/from the base station 4. 

FIG. 4 is a view showing the structure of a packet 
sem from the portat)le terminal 1 . Each packet is consti- 
tuted by a header, portion and a data portion. The 
header portion stores a transmission source address, a 
transmissioh destination address, and the like. The 
address system containing an address to be stored as a 
transmission source address or a transmission destina- 
tion address is determined depending on the network 
structure to which this embodiment is applied. In, e.g... 
TCP/IP communication, an IP address is stored. 

TTie data portion, stores application identification 
information, a command, position information, time 
information, and sourxi information. The application, 
identification infbrnration is used to identify an applica- . 
tion program to be started^ on a destination teriirdnal 
(host terminal 3 in tilts embodiment). In this, embodi- . 
ment information for iderrtifying an action analysts pro- 
gram is set Note tiiat in TCP/IP communication, the 
applicati'on:identif ication information is designated as a 
portnunrtoer 

The comrinand is instruction inforhiation for the ter- 
minal (host temrtinal 3) designated by the transmission 
destination address and is interpreted on an application 
designated by appllcatioh kientification information. In 
this embodiment an action analysis command or. an 
analysis result request command is used. 

The position irrformation represents the poation of 
the portak)le terminal 1 and conresponds to the position 
of the user who is canying the portable terminai. TTiis 
position information : is sequentially prepared on the 
basis of the output from ihe.GPS sensor 14. The time 
information represents time when the position informa- 
tion. I.e.. the output from the GPS sensor 14 is detected, 
and corresponds to the output from the timepiece 38. 
The sound infohtiatioifr. is sourxJ data acquired through 
the microphone 1 2 at the timing when the position infor- 
mation is detected. In tiiis embodiment, sound informa- 
tion is acquired as ambient information of the portable 
terminal 1 . However, a tenrperature sensor or a camera 
may be arranged to acquire temperature or image infor- 
mation as ambient information. 

FIG. 5 is a flow chart of an operation of preparing a 
packet from data acquired by the portat)ie terrrtinal and 
sending the packet The program, for realizing the iunc- 
tions of this f fow chart is stored in the storage unit 22 as 
a form of program code which can be read by the CPU 
21. In this processing, the portable terminal 1 acquires 
position information, time information, and sound inlbr- 
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mation N times at a predetermined time interval, trans- 
fers all the acquired information to the host terminal 3, 
and requests action analysis processing. Assume that 
the portable terminal 1 is always executing the program 
for acquiring position information, time information, and 
sound information while the power is ON. 

In steps SI and S2. predetermined time interval 
data is set for the timer 39. and the timer 39 is started. 
When the timer 39 has counted a predetermined time 
<e.g.. one minute), an interrupt signal is ffiput tothe CPU 
21 via the bus 23. so that processing from step S3 is 
executed. 

In step S3, the output (position information) from 
the GPS sensor 14 is acquired. In step S4, the tinte 
(time information) counted t>y the timepiece 38 Js 
acquired. In step S5, the timer 39 is reset. In step. S6. 
ambient sound data (e.g.. noise) collected ttirough the 
microphone 12 Is acquired. This sound collection 
processing is performed for. e.g., 5 seconds. The timer- 
39 is reset and starts the time counting operation again. 

In step S7, the information acquired in steps S3. . 
S4, and S6 are temporarily held in the RAM in the stor- 
age unit 22. In step S8. a counter (not shown) is incre- 
mented by one. In step S9. the count value of the 
counter is checked. If the count value has reached "N - 
(N: positive integer)**, the flow advances to step SIO. If 
thie count value has not reached N. the fbw returns to 
step 82 (to wait for the next interrupt signal from the 
timer 39). In step 81 0. the count value of the counter is 
cleared. 

In step 31 1 . the packet shown in FIG. 4 is prepared. 
The addresses of the portable tarminal 1 and the host t 
terminal 3 are set as a transmission source address and 
a transmission . destination address, r^ectively. As* 
application identification information and a command, 
an "action analysis program" and an ""action analysis 
command" are set. As position information, time infor- 
mation, and sound information, the pieces of infonna- 
tion acquired in steps S3. 84. and 86 are read out from • 
the storage unit 22 and stored in the packet. The posi- 
tion information, time information, and sound informa- 
tion to be stored are data acquired N times. In step 81 2. 
the packet prepared in step 81 1 is output by radio. The 
packet is transferred to the host terminal 3 in accord- 
ance with the transmission destination address set. in 
the header portion. ; * ; 

In the above embodiment, all the acquired data cor- 
responding to N cycles are transferred from the portable 
terminal 1 to the host terminal 3 to reduce the transmfe- 
sion cost However, the data may be transferred when 
the acquired data reaches a predetermined capacity. 
Alternatively, position information, time information, or 
sound information may be transferred to the host termi- 
nal 3 every time the information is acquired. In the 
at)ove emt>odiment the flow chart shown in FIG. 5 is 
autonomously executed by the portable terminal 1. 
Altematively. the processing of transmitting the packet 
to tiie host side may be executed in accordance with a 



starting instruction which is regularly transmitted from 
the host terminal 3. 

FIG. 6 is a block diagram of the host terminal 3. A 
storage unit 51 is constituted by a semiconductor mem- 
5 ory. a magnetic recording medium, or an optical record- 
ing medium arxi stores a program, data, and tiie like. 
The storage unit 51 may be permanentiy incorporated 
or detachably mounted in the host terminal 3. 

A recording medium driver 52 reads out data stored 
70 in a portable recording medium (including a semicon- 
ductor memory, a magnetic disK an optical disk, and a 
magnetooptical disl^ 53 or writes data in the portatsle 
receding medium 53. A comnnunication control unit 54 
oontrols data transmission/reception to/trom the net- 
15 work. Packet transmission/lreception to/from each porta- 
ble terminal is also conbolled by the communk^ation 
r corrtrol unit 54. 

A CPU 55 loads the progrsun from the storage unit 
' 51 or the portable recording medium 53 and executes 
20 the program. The program and data recorded in the 
storage unit 51 may be written from the portable reoord- 
. tng medium 53 or received from afx>ther device on the 
network through the communication line or the fike and 
recorded- The CPU 55 may use a program and data 
- 25 Stored in another storage unit arranged on the network 
through the communication line or the like 

FIG. 7 is a flow chart for eocplaining processing in 
the host ternrtinal 3. In.thts example, a. packet sent from 
the portable terminal 1 (packet prepared with process- 
so: ing of the fbw chart shown in FIG. 5) is received to ana- 
lyze the action of the user who is carrying the portafc»le 
: terminal 1 . . . » 

In step 821. the transnrtisskm source address 
stored in the header portion of the . received packet is 
35 checked to recognize the transntission terminal. In this 
case, the transmission terminal is assumed to be the 
portable termineil 1 . The application identification infor- 
mation and the command arer checked. In this case. 
) assume that an "action analysis program" and an 
40 "action analysis command" are sist . 

In step 822, position information and time infbrma- 
. tion, which are stored in the data portion of the received 
packet, are extracted to recognize the position (X|,yj) of 
the portable termina! 1 at time T|. In step 823. the mov- 
45 ing cfirection arKi moving speed of the portable terminal 
'.^ r-- 1 from time T^^ to time Tj are calculated. 

In step ^4. the cateulation result, obtained in step 
S23 is used to estimate the moving means (walking, 
train, motor vehicle, stop, • • • ) of the user who is car- 
50 rying the portable terminal 1 . More specifically, the posi- 
tion of the user who is carrying the portalDle terminal 1 
at a certain time point, and if he/she is moving, the mov- 
ing means are estimated. In this processing of estimat- 
ing the moving means, sound information stored in the 
55 data portion of the received packet is used, as needed. 
In step S25, the estimation result otstained in step 824 
is stored in the personal action fSe of tiie user who is 
carrying the portable terminal 1 . 
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The operation of the flow chart shown in FIG. 7 will 
be described below in more detail. A case wherein the 
user who was carrying the portable terminal 1 rmed 
from station A to station B b/ A railway, as shown in FIG. 
8. will be described. s 

Upon receiving an action recording start command 
from a key input means (not shown) of the portable ter- 
minal 1 , or the host terminal 3, the portable tenminal 1 
executes the processing of the flow chart shown in FIG. 
5 and detects the output from the GPS sensor 1 4 at time io 
Tq, T^,T2, • • • , T-,0. The detected pieces of position 
information conrespond to position data Pq. Pi. P2. 
• • Pio- In detecting tiie position information, the 
portable terminal 1 fetches sound information acquired 
through the microphone 12. For example, it is estimated 75 
that, in a station, various types of noise are detected, 
and in a train, sounds unique to the train are detected. 
The portable terminal 1 transfers the detected position 
information, time Information, and sound information to 
the host terminal 3. Since tiie data detected by the GPS 20 •. 
sensor 14 have errors, points designated by the position 
information (position data Po» Pi. P2» • • • . Pio) do not 
always match the line. 

Upon receiving the information transferred from the 
portable terminal 1, the host terminal 3 executes the 2S 
processing of the f fow chart shown in FIG. 7 to analyze 
the moving route of the user who is carrying the porta-> 
ble terminal 1. For the purpose of analyzing the route, 
the host terminal 3 has map data as shown in FIG. 9. 
FIG. 9 shows part of the position information of the line 30 
of A railway (position information of the line between 
station A and station B) as an example. 

As shown in FIG. 9, pieces of information repre- 
senting the positions of stations (in this case, station A 
and station B) are stored. The position information of ^ 35 
the line Is stored as approximate curves of the line. In 
this example, tiie line between station A and station B is 
divided into four sections, and an approximate curve 
equation is defined for each section. ' 

The host terminal 3 also stores map data assoqi- 40 
ated with all railways. Not only data associated with rail- . ; 
ways txit also data associated with roads are stored in - 
the host terminal 3. These map data are stored in. e.g.. 
the storage unit 51 and loaded in the memory 56 as a 
reference, as needed: : , • = . 45 

FIG 1 0 is a flow chart (1 ) for explaining processing 
of estimating the action of tiie user who is' carrying the 
portable terminal 1. This processing conresponds to 
steps S23 and S24 in FIG 7. 

In step S31 . the average moving speed of the user so 
who is canrying the portable temninal 1 is calculated. 
More specifically, the average moving speed of the port- 
able terminal 1 from time Tj.^ to time Tj is calculated 
according to the following formula. At this time, the mov- 
ing direction is simultaneously calculated: ss 



In step S32^^ it is checked whether the speed calcu- 
lated in step S31 is 1 km/h or less. If YES in step S32. it 
is estimated in step S33 that the user is "stopping**. If 
NO in step S32; the flow advances to step 834. 

In step S34. it is checked whether the speed calcu- 
lated in step S31 is 6 km/h or less. If YES in step S34. it 
is estimated in step S35 that the user is "^walking". If NO 
in step 834. the flow advances to st^ S36. 

In step 836. it is checked whether the moving focus 
of the user who is carrying the portable terminal 1 is 
similar to the railmyJine pattern stored as map data. In 
this case, distances from the points designated t>y posi- 
tion data Pq. Pi. P2. * • • . P10 to tiie curves repre- 
sented by the curve equation representing the railway 
line are calculated by. .e.g.. the method of least squares. 
and determination is-made on the basis of whether each 
calculated value is equal to or smaller than a predeter^ 
mined value.: Alternatively, determination is made on the 
basis of the similarity i>etween a locus drawn by at least 
two position data and a curve pattern representing the 
railway line. ' Determination in this step is performed 
using a known technique. . and a detailed description 
thereof will be omitted; :* 

If the moving- lbcus of the user who is carrying the 
portable terminal 1 is similar to the fine pattern, it is esti- 
mated in step S37 that the user is "moving by train". If 
the moving locus is not similar to the line pattem. it is 
estimated in step:838 that the user is "moving by motor 
vehicle (automobile or bus)". , . 

The estimation result obtained in this way is held in 
a predetermined area on the memory 56 as data of 
action (movement situation) of the user who is carrying 
the portable terminal 1 at a certain time point. The host 
terminal 3 sequentially stores the estimation result data 
at each time (time when the position information and the 
. like are detected tsy the portable terminal 1). 

FIG. 11 is a f tow Chan (2) for explaining processing 
of estimating the action of the user who is carrying the 
portable terminal 1. This processing corresponds to 
step S24 in FIG. 7 and is executed parallel to the 
processing shown. in FIG. 10.-' 

: In step 841 , sound information stored in the packet 
transfen-ed from the portable terminal 1 is extracted. In 
step 842. the sound information is analyzed to recog- 
nize the characteristic features of the sound informa- 
tion. In step 843, it is checked whether the sound 
infomiation analyzed in step S42 includes unique 
sounds generated in a running train. If YES in step 843. 
it is estimated in step S44 that the user is "moving by 
train", ff NO in step 843, tiie ftow advances to step 845. 

In step 845, it is checked whether the sound infor- 
mation analyzed in step 842 includes unique sounds 
generated in a running motor vehicle or bus. If YES in 
step 845. it is estimated in step 846 that tiie user is 
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"moving by motor vehicle". If NO in $ief> S45, the sound 
information is discarded in this estimation processing. 

The host terminal 3 holds in advance a unique 
sound pattern generated in a running train and a unique 
sound pattern generated in a running automobile or 
bus. In step S43 or S45, the similarity between the 
sourKi information extracted in step S41 and the held 
pattern is determined. 

The estimation result obtained b/ processing of the 
flow chart shown in FIG. 11 is used as information for 
increasing the likelihood ratio of the estimation result 
obtained by processing of the flow chart shown in FIG. 
10. 

FIG. 12 is a flow chart (3) for explaining prodesslng - 
of estimating the action of the user who is carrying the 
portatrfe terminal 1. In this processing, a pluraBty of esti- - 
mation results are obtained by processing of the flow 
charts shown in FIGS. 10 and 1 1 , and the action 6f the 
user who is carrying the portable terminal 1 is estimated 
at a higher likelihood ratio on the basis of these pieces 
of information: 

In step S51. M estimation results obtained by 
processing of the flow charts shown in FIGS. 10 and 11 
are extracted. When M = 5. and the action at tirhes T| is 
to be estimated, estimation results at time Ti.2; Ti_i; Tj, 

, and T^.2 are extracted. 

In step S52. H is checked whether all the M estiina- 
tion results extracted in step S51 are in the same state. 
If YES In step S52, the estimation results are regarded 
as an estimation result having a higher likelihood ratio. 
The flow advances to step S61 to hold the result 
together with the position information and the time infor- 
mation. Assume that all the estimation results otitained 
by processing of the flow chart shown in FIG.' 10 at 
times Ti.2. T}.-| , Tj, T^^'^ , and Ti+2 ''stop", the host ter- 
minal 3 estimates that the user who is carrying the port- 
at3le terminal 1 is stopping at the position represented 
by the position information at that time, and stores the 
estimation result in thei memory 56 or the storage unit 
51. 

If ft is determined in step 852 that the estlrnation 
results are different, it is checked in step S54 whether 
the M estimation results include only "stop" and "walk- 
ing". If YES in step S54, it is estirhated in step S55 that 
the user who is carrying the portable terminal 1 is "walk- 
ing". The fk>w advances to step 361 to hold the estima- 
tion result together with the position information and the 
time information. 

If. in step S54. the estimation results include esti- 
mation results other than "stop" and "walking", it is 
checked in step S56 whether a predetermined number 
or more of estimation results "rrxsving by ti^ain** are 
included. If YES in step S56. it is estimated in step S57 
that the user who is carrying the portable terminal 1 is 
"moving by train". The flow advances to step S61 to hoM 
the estimation result together with the position informa- 
tion and the time information. 

If NO in step S56, it is checked in step S58 whether 



"moving by motor vehicle (automotMie or bus)" is 
included. If YES in step S58, it is estimated in step 359 
that the user who is carrying the portable terminal 1 is 
"moving by motor vehicle". The flow advances to step 

5 361 to hold the estimation result together with the posi- 
tion information arKi the time information. If NO in step 
S58. error processing is executed in step S60. 

With the above procedure, estimation results as 
shown in FIG. 13 are ot>tajned. The algorithm for est- 
10 mating the action of the user who is carrying the porta- 
ble terminal 1 is not limited to the at>ove algorithm, and 
another method may t>e used. 

A procedure of preparing an action record table as 
shown in FIG. 14 will be descrfoed. FIG. 15 is a flow 

IS chart of processing of preparing the action record tattle 
of the user who is carrying the portable terminal 1 . 

In step 371 . "stop" is extiracted from the estimation 
results shown in FIG. 13. and the start time and end 
time are checked. The position information is also 

20 ' extracted. In step S72, it is checked whether the stop 
position extracted in step 371 is a position registered in 
• advance. For this determination, the host termirral 3 
refers to a table shown in FIG. 1 6. The table shown in 
FIG. 16 stores various names on the rnap and corre- 

25' sponding position information. Railway stations and 
other publk: lacirities are registered in advance. In addi- 
tion, the user can register a desired location. In this 
emi^odiment ''head office", "business office". "Mr. Ks 
house", are registered. 

30 If YES in step 372, the name of the registration 
position is extracted in step S73. If NO in step S72. the 
region name of the position (e.g., xx Prefecture xx City 
XX) is extracted in step iS74. Note that the host terminal 
3 has a table storing region names and corresponding 

35 position information. 

In step 375. the registration position name 
extracted in step 373 or the region name extracted in 
step 374 is written for the time zone of "stop" recog- 
nized in step 371 . Assume that the user who was carry- 

40 ing the portable ternrtinal 1 wds in the head office before 
14:10. In this case, the position inform at ion detected by 
the portable terminal 1 before 14:10 must be equal or 
approximate to position data (xgoi.ysoi) registered in 
the table shown in FIG. 16. The position information 

45 detected by the portable terminal 1 is transferred to the 
host terrnlrml 3 and stored in the table shown in FIG. 1 3. 
In processing iri steps 372 through 374. the host termi- 
nal 3 recognizes that the user who was carryirig the 
portafc>le terminal was in the head office before 14:10 

50 because the position information detected by the porta- 
■ k>le terminal 1 is equal or approximate to the position 
data registered as the position of the head office. As a 
result, liead office" is written for the time zone before 
14:10, as shown in FIG. 14. 

55 In step 376. the moving means (walking, train, 
automobile, or bus) r^resented by the akxve- 
described estimation result and the start time arxJ end 
tiiTie of movement using the rraving means are 
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checked- As shown in FIG. 14, the moving means is 
written for each time zone. When a specific means of 
transportation is used, the means of transportation is 
written in step S77. Assume that it is esbrated from the . 
similarity to the railway line pattern stored as map data s 
shown in FIG. 9 that the user who was carrying the port- 
able terminal moved from station A to station B by A rail- 
way» -A railway" is written as a moving means, and 
region names "station A" and "station B** are written as 
a starting point and a ternninat point, respectively. to 

The action record table prepared in the at>ove way 
is stored in a predetermined area in the storage unrt 51 
of the host terminal 3. When the user who is canrying 
the portable terminal 1 is to display the action record , 
table on the portat^le terminal 1 ; a packet for requesting is 
display of the action record table is sent from the porta- 
ble terminal 1. The request packet has the structure . 
shown in FIG. 4. The addresses of the portable terminal 
1 and the host terminal 3 are set as a transmission 
source address and a transmission destination address, 20 
respectively. An "action anatyss program" is set as 
application icientification inf6rmatk)n, and an "analysis 
result request command" is set as a commarKJ. A date 
to be referred to is added as additional information of 
the command. The command and the additional infor- 25 
mation of the command are input by the user using, 
e.g.. a pen input method from the LCD display imit 1 1 of 
the portable terminal 1 . . 

Upon receiving the command having the "analysis 
result request command** from the portable terminal 1 . 30 
the host terminal 3 interprets the command and extracts 
the action record table of the user who is carrying the 
portable terminal 1 . at the designated date. The 
extracted action record table is stored in a packet and 
transferred to the portable terminal 1 . The portable ter- as 
minai 1 extracts the action record table from the packet 
transferred from the host terminal 3 and displays it on . 
the LCD display unit 1 1 . 

The processing programs executed by the host ter- 
minal 3. I.e., programs for realizing the furictions of the 40. 
flow charts shown in FIGS. 7; 10. 1.1, 12, and 15, and ^ 
the program for interpreting a commarrd trarolerred = 
from the portable terminal 1 and processirig the com- 
mand are stored in.the storage unit 51 or the portable 
recording medium 53 in the form of program codes < 45 
which can be read by the CPU 55. Alternatively, pro^ . 
grams stored In another device connected; through tfie 
network are used. 

As described above, in the action analyzing system 
of this emtx)diment, position information and time infor- so 
mation are detected by the portable terminal 1 and 
transferred to the host terminal 3. and the action record 
of the user who is carrying the portable terminal 1 is 
automatically prepared on the host side. For this pur- 
pose, the pcNTtable terminal 1 need have only a functton ss 
of detecting position information and time information 
and transferring them to the host terminal 3, a function 
of requesting the host termirial 3 of an action record. 



arxj a function of delaying data downloaded from the 
host terminal 3. ThsX is. the portable terminal 1 need 
neither store an enormous quantity of map data nor 
execute highly precise pattern recognition processing or 
various processirig which reqirire high-speed process- 
ing. For this reason, the portable terminal 1 can obtain 
an advanced action analysis result without requiring! any 
large-capacity memory or high-performance processor. 

In the above embodiment, position information and 
time information are detected by the portable terminal 1 
at a predetermined timing. However, the present inven- 
tion is not limited to this arrangement. Generally, the 
user of the nrxyvable terminal is not always moving and 
can be considered to stop at a certain position for most 
of time If tfie.userpf the portable terrninal stops at a 
certain portion for a predetermined time or more, posi- 
tion information need riot be detected every predeter- 
mined time. arKi not, all the position information need be 
supplied frprn the portat>le terminal 1 to the host termi- 
nal 3. . , ^.'.'^^ ■.:,- v,Vv 
^ FIG. 17 is a flow chart showing an operation of pre- . 
paring a pactot frpm c^^ acquired by the portable terr 
minal 1 and sertding . the packet This processing 
procedure is obtained, by adding steps S81 through S83 
tp the flow chart shown Jn FIG. 5. 

In step 881 . it is checked whether the position infor- 
mation obtained in step S3 coincides with position infor- 
mation of one and. two c^les before If NO in step S81 . 
the flow advances to step S7 to continue the processing 
in FIG. 5. If yi^S in step.SSI, the position information, 
time inforniation. and sound information at the preced- 
ing timing are discarded in step 382. Iri step S83. the 
counter which is {to be i rtcremented by one in step S8 is 
decremented t)y one: . 

Processing of the ftow chart shown in FIG. 17 will 
be described in more detail. A case wherein the user 
who was carrying the movable terminal 1 was continu- 
ously present at position Pq and time T^ through time T4 
(times detected in sxesp S4) will be descrit)ed. 

"Position Pq" is detected by position detection at 
time and tinieT2, and these data are hek:! In step S7. 
At time T3, "pdsition^Po" is . detected again. In step S81. 
the position data at time coinckies with position data 
of one (time Tg) and two (time T^) cycles before. The 
flow adK/ances to step 882 to discard the position irrfor- 
mation. time information, and sound information 
acquired at the preceding timing (time Tg). Thereafter, 
the position data at time T3 is held in step S7. As a 
result, only the pieces of information acquired at time T^ 
arxf time T3 are held. 

•^Position Pq" is detected at time T4 again. Since, in 
step S81. . position data at time T4 coincides with posi- 
tion data of one (time T3) and two (time T^) cycles 
before, the f fow advances to step 882 to discard posi- 
tion information, time information, and sound informa- 
tion acquired at the preceding timing (time T3). At this 
time point, the information at time T2 have , been dis- 
carded, and time Ti corresponds to the tinning of two 
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cycles be?fore". Thereafter, the position data at time T4 is 
held in step S7. As a result only the pieces of informa- 
ton acquired at time Tf and time T4 are held. 

As descrilDed above, when the user wto was carry- 
ing the movat)le terminat 1 continuously stayed at a cer- s 
tain position for a predetermined time or more, only 
position information, tinrie infbm^on, and sound infor- 
mation at the start and end of "stop" are held and trans- 
ferred to the host terminal 3. With this arrangement 
transfer of redundant infonmation (in the above example. 10 
information acquired at time T2 and time T^) can be 
reduced. 

In the atX3ve emtxxliment, the GPS sensor is used 
as a means for detecting the position information of the 
portable terminal 1. However, the present invention is is 
not limited to ttits. For a motxie communication network 
whose cell range is narrow, a cell which is currently 
managing the portable terminal may be used as posi- 
tion information. 

In the above embodiment, the action record table 20 
has the form of a timing chart as shown in FIG. 14. How^ 
even the present invention is not limited to this. . For 
example, an illustration as shown in FIG. 18 nriay- be 
used. " ' . 

In the above embodiment, position infbrmatioh br ; 2S 
time Information is detected at a predetermine time 
interval. However, such information need not always be 
detected at a predetermined time interval. Information 
may be appuiopriateiy sampled a sufficient number of 
times for action analysis. 30 

In the above emtxxliment, the action of the user ^ . 
who is carrying the movable terminal is analyzed. How- 
ever, the arrangement is not limited to the appFication 
purpose of detecting the human action. The arrange- 
ment can also be applied to survey the action pattern of 3S 
an animal or check the delivery state of goods. 

Claims 

1. An action analyzing/recoiding system character- 40 
ized in thiat lrtlbrniatk>n transnutted through a com- 
munication control unit of a terminal (1) is analyzed 

by an information processing unit connected to a 
network (2) as an action record, data of an analysis 
result is stored in correspondence with a terminal 4S 
identification code, and the data is transferred to 
said terminal as needed, said ternrtinal comprising a 
detector (14) for detecting position information and 
time information, and said communication corrtrot 
unit (40) for network connection, arxJ transmitting so 
the information detected by said detector together 
with the terminal identification code. 

2. A system according to claim 1 . characterized in that 
said temriinal accumulates the detected irribrma- ss 
tion. and after the information has reached a prede- 
termined numt>er or predetermined capacity, 
transmits the accumulated information at once. 



3. A system according to daim 1 . characterized in that 
when position information representing ttiat said 
terminal stays at a certain position is detected, said 
terminal is controlled not to transmit information 
twice. 

4. A system according to claim 1 . characterized in that 
said information processing unit has means (51) for 
storing map information representing a transport 
route including a railway line, specifies information 
of a place of movement on the basis of the map 
information and the position and time information 
transmitted from said terminal, and stores the place 
ffiformation together with time. 

5. A system according to claim 1 . characterized in that 
said information processing unit calculates a mov- 
ing speed from the position and ilme information 
transnnitted from said terminal to estinriate a moving 
means. 

6. A system according to daim 5, characterized by fur- 
ther comprising means for detecting ambient infor- 
mation induding sound information, and wherein 
said estimating means specifies the action route in 
conskJeration of the detected ambient information. 

7. A system according to daim 5, wherein saki infor- 
rnation processing unit has means (51) for storing 
map information represerrting a transport route 
induding a railway line and specifies a name of a 
transjx>rt facility on the t>asis of the map information 
and the analyzed moving means. 

& An action analyzirig/irecbrcSng system comprising: 

means (14) for detecting position information 
and time information of a terminal; 
means (3, FIGS. 10 and 11) for analyzing a 
moving locus and a moving speed of said ter- 
minal on the basis of the detected position and 
time infbrmation; 

means (3, FIG. 12) for estimating an action 
route on the fc^asis of the analyzed data; and 
means (3. FIG 15) for storing, on the basis of 
the estimated action route, information of a 
place and time of action as an actfon record. 
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